Hyperparameter on-line learning of stochastic resonance based threshold networks

Aiming at training the feed-forward threshold neural network consisting of nondifferentiable activation functions, the approach of noise injection forms a stochastic resonance based threshold network that can be optimized by various gradient-based optimizers. The introduction of injected noise extends the noise level into the parameter space of the designed threshold network, but leads to a highly non-convex optimization landscape of the loss function. Thus, the hyperparameter on-line learning procedure with respective to network weights and noise levels becomes of challenge. It is shown that the Adam optimizer, as an adaptive variant of stochastic gradient descent, manifests its superior learning ability in training the stochastic resonance based threshold network effectively. Experimental results demonstrate the significant improvement of performance of the designed threshold network trained by the Adam optimizer for function approximation and image classification.     

Differentiable spaces that are subcartesian

We show that the differential structure of the orbit space of a proper action of a Lie group on a smooth manifold is weakly reflexive. This implies that the orbit space is a differentiable space in the sense of Smith, which ensures that the orbit space has an exterior algebra of differential forms, that satisfies Smith’s version of de Rham’s theorem. Because the orbit space is a locally closed subcartesian space, it has vector fields and their flows.     

Mass distribution and skewness for passive scalar transport in pipes with polygonal and smooth cross sections

We extend our previous results characterizing the loading properties of a diffusing passive scalar advected by a laminar shear flow in ducts and channels to more general cross‐sectional shapes, including regular polygons and smoothed corner ducts originating from deformations of ellipses. For the case of the triangle and localized, cross‐wise uniform initial distributions, short‐time skewness is calculated exactly to be positive, while long‐time asymptotics shows it to be negative. Monte Carlo simulations confirm these predictions, and document the timescale for sign change. The equilateral triangle appears to be the only regular polygon with this property—all others possess positive skewness at all times. Alternatively, closed‐form flow solutions can be constructed for smooth deformations of ellipses, and illustrate how both nonzero short‐time skewness and the possibility of multiple sign switching in time is unrelated to domain corners. Exact conditions relating the median and the skewness to the mean are developed which guarantee when the sign for the skewness implies front (more mass to the right of the mean) or back (more mass to the left of the mean) “loading” properties of the evolving tracer distribution along the pipe. Short‐ and long‐time asymptotics confirm this condition, and Monte Carlo simulations verify this at all times. The simulations are also used to examine the role of corners and boundaries on the distribution for short‐time evolution of point source , as opposed to cross‐wise uniform, initial data.     

Properties of bounded stochastic processes employed in biophysics

Abstract

Realistic stochastic modeling is increasingly requiring the use of bounded noises. In this work, properties and relationships of commonly employed bounded stochastic processes are investigated within a solid mathematical ground. Four families are object of investigation: the Sine-Wiener (SW), the Doering–Cai–Lin (DCL), the Tsallis–Stariolo–Borland (TSB), and the Kessler–Sørensen (KS) families. We address mathematical questions on existence and uniqueness of the processes defined through Stochastic Differential Equations, which often conceal non-obvious behavior, and we explore the behavior of the solutions near the boundaries of the state space. The expression of the time-dependent probability density of the Sine-Wiener noise is provided in closed form, and a close connection with the Doering–Cai–Lin noise is shown. Further relationships among the different families are explored, pathwise and in distribution. Finally, we illustrate an analogy between the Kessler–Sørensen family and Bessel processes, which allows to relate the respective local times at the boundaries.     

Crosslinked poly(ethylene oxide) containing siloxanes fabricated through thiol‐ene photochemistry

Homogenous amphiphilic crosslinked polymer films comprising of poly(ethylene oxide) and polysiloxane were synthesized utilizing thiol‐ene “ click ” photochemistry. A systematic variation in polymer composition was Carried out to obtain high quality films with varied amount of siloxane and poly(ethylene oxide). These films showed improved gas separation performance with high gas permeabilities with good CO₂/N₂ selectivity. Furthermore, the resulting films were also tested for its biocompatibility, as a carrier media which allow human adult mesenchymal stem cells to retain their capacity for osteoblastic differentiation after transplantation. The obtained crosslinked films were characterized using differential scanning calorimetry, dynamic mechanical analysis, thermogravimetric analysis, FTIR, Raman‐IR , and small angle X‐ray scattering. The synthesis ease and commercial availability of the starting materials suggests that these new crosslinked polymer networks could find applications in wide range of applications. © 2015 Wiley Periodicals, Inc. J. Polym. Sci., Part A: Polym. Chem. 2015 , 53, 1548–1557     

Epidemiological models with quadratic equation for endemic equilibria—A bifurcation atlas

The existence and occurrence, especially by a backward bifurcation, of endemic equilibria is of utmost importance in determining the spread and persistence of a disease. In many epidemiological models, the equation for the endemic equilibria is quadratic, with the coefficients determined by the parameters of the model. Despite its apparent simplicity, such an equation can describe an amazing number of dynamical behaviors. In this paper, we shall provide a comprehensive survey of possible bifurcation patterns, deriving explicit conditions on the equation's parameters for the occurrence of each of them, and discuss illustrative examples.